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INTRODUCTION AND SUMMARY 

1. The nature of statistical evidence. 

2. Its relation to questions of smoking 
and health. 

3. The uitfalls of unwarranted inference. 

4. Listing—with explanation of each—of 
the approximately 12 categories into 
which questions of statistical 
interpretation can be c-rouned. 

5. Summary of the 12 categories, with 
brief description of the examples to 
be covered under each. (Revision and 
annotation of this summary after the 
rest of the material is completed will 
turn it into a kind of quick-reference 
index to it.) 




I. HOW A SAMPLE MAY BE BIASED 

Categorizing of principal ways in which bias 
appears in sampling studies. 

Examples of studies into which bias has been 
introduced, nearly always inadvertently, by 
each of these sources. Examples from medical 
(primarily) and other fields, such as polling. 

Application of the bias question to studies 
that have been produced on smoking. 


II. WHAT MAKES A SAMPLE ADEQUATE 

Direct relationship between the size of a 
sample and the reliability of conclusions 
from it. 

Influence of absolute size and size relative 
to population or universe in question. 

Examples of erroneous or unsupported conclusions 
from inadequate samples. 

Inadequate samples in some smokiner studies. 
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III. STATISTICAL SIGNIFICANCE 

Meaning of the term; how derived; how expressed. 

Examples of degrees of significance as used 
in different fields. 

Significance vs. certainty; the ever-remaining 
chance that even statistically significant 
conclusions are false. 

Significance of conclusions in various studies 
of smoking and health. 



IV. EPIDEMIOLOGICAL STUDIES vs. CONTROLLED • 
EXPERIMENTS 

The innate disadvantages of population studies 
compared with experimental evidence. 

Use of controls from Lind (mid-18th Century) 
through adoption of double—blind techniques 
by end of World War II. 

Placebo effect. 

Comparison between rigor of chemotherapeutic 
designs since Koch and those underlying 
population studies such as those on smoking. 


V. AVERAGES AND RANGES 

The several different concepts expressed by 

the term average. The usefulness of each 

and the choice'among them. Bias from poor choice. 

Deviation and range. Weaknesses of averages 
without them. 

Examples and applications. 


Source: https://www.industrydocuments.ucsf.edu/docs/spcb0003 
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VI. REPORTING AND CLASSIFYING DATA 


Why this Is a problem at the heart of 
interpreting statistical material, 
especially population studies. 



How errors or decisions in this field have 
produced strange conclusions, especially in 
medical matters. 

Relevance to smoking nnestiohs (e.g., the 
reported increase in long cancer). 


VII. THE OMITTED FIGURE 

Kinds of information in the absence of which 
conclusions cannot soundly be drawn. 

What to look for and how to discover its 
absence. 


Examples and application. 


VIII. MISLEADING EFFECT OF OVERPRECISE FIGURES. 

Why precise numbers may mislead by their 
very precision. 

Conclusions carried beyond their data. 

Examples, medical and otherwise. 

Application to smoking studies including those 
cited in Surgeon General's report. 


IX. SEMI-ATTACHED FIGURES 

Why this, although more a semantic problem 
•than a mathematical one, lies at the heart 
of interpretations of statistical material. 

How it permits impeccable statistical techniques 
to produce entirely false conclusions. 

Examples; relevance to smoking'studies. 
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X. GRAPHIC TECHNIQUES 

Major methods; proper and improper use of each. 
Examples. 

Application to medical material, including data 
on smoking and health. 



XI. STATISTICAL INFERENCE ANT)' JUDGMENT 
From figures into words. 

Bandwagon effect: tendency to give unwarranted 
weight to a collection of indications even when 
none has clear validity. 

Half-emoty vs. half-full: influence of the 
way information is expressed. 

Application to smoking studies. 



XII. CORRELATION AND THE POST HOC FALLACY 

Difference between correlation and causation. 

The three possibilities (A causes B; B causes A; 
both are produced by some outside cause). 

Examples of spurious correlations. 

Correlation and the .studies of smoking and 
health. 
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